A Summer of Nuggets

Charles F Vardeman II

2023-08-28

And a Reminder of Some Before…

Where we started…

Where we’re going…

Dr. Vardeman, this is a lot of material!

This is meant to provide something of a “Roadmap”!

Old School AI and the Web…

A vision of “Ontologies”, “Linked Data”, and “Software Agents”…

Old School “Cool” AI and the Web (2001)…

The semantic web had a vision of Agents with Shared Understanding through Ontologies, the ability to Use Tools Like the Web and Consume a Web of Linked Data as Distibuted Knowledge Graphs.

What’s an Ontology?

Ontology Design Patterns

Google Search and the “Semantic Web”

Knowledge Graphs

Knowledge Graphs

What’s a Knowledge Graph?

AI in 2023..

The “AI Social Disruption”

Pretrained Foundation Models…

Evolution of Large Language Models

How to Build a ChatGPT?

“The state of GPT” – You should watch this!

“The state of GPT”

Large Language Models from a more general view…

Text to numbers…

Base models create general representations through “Pre-Training” (GPT)

Base models create general representations through “Pre-Training” (GPT)

“Pre-Training Datasets?”

LLama: Open and Efficient Foundation Language Models

LLama: Open and Efficient Foundation Language Models

Gao et al. “The Pile”?

Gao et al. “The Pile”?

What could go wrong?

What could go wrong?

What could go wrong?

“Would I forbid the teaching (if that is the word) of my stories to computers? Not even if I could. I might as well be King Canute, forbidding the tide to come in. Or a Luddite trying to stop industrial progress by hammering a steam loom to pieces.” – Stephen King

(GPT-3) Language Models are Few-Shot Learners (2020)

(GPT-3) In-Context Learning

(GPT-3) Instruct-GPT Reinforcement Learning from Human Feedback

(GPT-3) Instruct-GPT Reinforcement Learning from Human Feedback

(GPT-4) “Sparks of AGI”?

(GPT-4) “Sparks of AGI”?

(GPT-4) “Sparks of AGI”?

(GPT-4) “Sparks of AGI”?

LLM Behavior Changes with Time!

(GPT-4) OpenAI Reinforcement Learning – “Towards TruthGPT”

(GPT-4) OpenAI Reinforcement Learning – “Conceptual Models”

(Claude) “Constitutional AI”

(Claude) “Foundation Model in AWS Bedrock”

(Llama 2)“Open-License” Large Language Models

“The state of GPT” Recommendations

Reasoning…

(GPT-3) Large Language Models are Zero Shot Reasoners (Chain-of-Thought Reasoning)

(GPT-3) Large Language Models are Zero Shot Reasoners (Chain-of-Thought Reasoning)

ReAct: Synergizing Reasoning and Acting in Language Models

ReAct: Synergizing Reasoning and Acting in Language Models

ReAct: Synergizing Reasoning and Acting in Language Models

Prompt Engineering

Large Language Models are Semantic Reasoners

Large Language Models are Semantic Reasoners

Our Research…

Retrevial Augmented Generation

Knowledge Graphs and LLMs – Must Read!

Knowledge Graphs and Frameworks

What About Trusted AI?

How to talk about LLMs? Must Read!